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Abstract 

The paper concerns small-area estimation in the Fay-Herriot type area-level 
model with random dispersions, which models the case that the sampling errors 
change from area to area. The resulting Bayes estimator shrinks both means and 
variances, but needs numerical computation to provide the estimates. In this paper, 
an approximated empirical Bayes (AEB) estimator with a closed form is suggested. 
The model parameters are estimated via the moment method, and the mean squared 
error of the AEB is estimated via the single parametric bootstrap method. The 
benchmarked estimator and a second-order unbiased estimator of the mean squared 
error are also derived. 

Key words and phrases: Asymptotic approximation, benchmark, constrained 
Bayes, empirical Bayes, Fay-Herriot model, mean squared error, parametric boot¬ 
strap, random dispersion, second-order approximation, second-order unbiased esti¬ 
mate, small area estimation, variance modeling. 


1 Introduction 

Small area estimation (SAE) using linear mixed models has been extensively studied in 
the literature from both theoretical and applied points of view. For a good review and 
account on this topic, see Ghosh and Rao (1994), Pfeffermann (2002), Rao (2003) and 
Datta (2009). Of these, the Fay-Herriot model introduced by Fay and Herriot (1979) has 
been used as an area-level model in SAE. 
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Suppose that there are m small areas and that y\,..., y rn are direct estimates of small 
area means. The Fay-Herriot model is described as 


Vi | ii /”(&, a, 2 ), 

& ~N{zJf3,r 2 ), 


where Zj is a vector of auxiliary variables and (3 is an unknown vector of regression coeffi¬ 
cients. Although of s are treated as known variances in the Fay-Herriot model, in practice, 
of are estimated quantities, and the resulting empirical Bayes (EB) estimators involve 
substantial estimation errors. To take this point into account, we suppose that statistics 
Vi,...,V rn are available for estimating of and that Vi/of has a chi-square distribution 
with rii degrees of freedom. Then, Wang and Fuller (2003) provided estimators of the 
mean squared error (MSE) of the empirical Bayes estimators. For such variance modeling 
approaches, see Arora and Lahiri (1997), You and Chapman (2006), Dass, Maiti, Ren and 
Sinha (2012), Jiang and Nguyen (2012). Also see Maiti, Ren and Sinha (2014) and the 
references therein. 

In the Fay-Herriot models with heteroscedastic unknown variances, each variance of 
cannot be estimated consistently based on Vi when rq’s are bounded. This leads to the 
inconsistency properties of estimation procidures, namely, the empirical Bayes estimator 
does not converge to the Bayes etimator, and the MSE of the empirical Bayes estimator 
cannot be estimated consistently. To fix this difficulty, Maiti, et al. (2014) suggested that 
of has an inverse gamma distribution. It is interesting to point out that the resulting 
empirical Bayes (EB) estimator of shrinks both means and variances. Since the EB 
includes integration with respect to of, however, the EB cannot be expressed in closed 
forms. Thus one needs numerical integration to provide values of the EB. Maiti, et al. 
(2014) derived a second-order unbiased estimator of the conditional mean squared error 
(cMSE) of the EB given (y l , Vf. However, one needs heavy numerical compilation to 
provide values of the estimator of cMSE. For unconditional MSE of the EB, no compu¬ 
tational algorithm was provided in Maiti, et al. (2014), because the computation may be 
much harder. 

In this paper, we consider to approximate the Bayes estimator in the Fay-Herriot 
random dispersion model given in Maiti, et al. (2014). Aprroximating the joint probability 
density function, we suggest the the approximated Bayes estimator 


pAB 

Si 


Zi(3 + 1 - 


1 + T 2 (ni + 1 + a)/{Vi + 7 ) 


)(Vi~zJl3), 


where a and 7 are model parameters in the distribution of of. Since 


Vi + 7 = + 1 V A _ rii + 1 \ 7 

rii + 1 + a rii + 1 + a Hi + l V m + 1 + a ) a ’ 

the estimator f AB is a dual shrinkage estimator with shrinking yi towards zj/3 and shrink¬ 
ing Vi/{rii + 1) towards 7 /a. This approximation is valid in the case of large rii, but we 
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want to use this closed-form estimator even for small n*. For the purpose, we need to 
evaluate the estimation error. Since includes the model parameters /3, r 2 , a and 7 , 
we estimate /3 with the generalized least squares estimator based on the approximated 
pdf and the other parameters r 2 , a and 7 via the moment methods. We show the consis¬ 
tency of the suggested estimators for the model parameters. Plugging-in the consistent 
estimators in £f B yields the approximated empirical Bayes (AEB) estimator The 

uncertainty of the AEB is measured via the the unconditional mean squared errors (MSE), 
and we obtain a second-order unbiased estimator of the MSE via the single parametric 
bootstrap method. 

In this paper, we also treat the benchmark problem. A potential difficulty of the 
AEB estimators £,f EB for small areas is that the overall estimate for a larger geographical 
area, which is constructed by a (weighted) sum of £,f EB , is not necessarily equal to the 
corresponding direct estimate like the overall sample mean. For instance, we consider the 
weighted mean y w = Y^=\ w iVj f° r nonnegative constants Wj’s satisfying Y^j=i w j = T 
Then, we want to find predictors Si’s which satisfy the benchmark constraint J2JLi w j^j — 
y w . A solution of the benchmark problem is the constrained Bayes estimation suggested 
by Ghosh (1992) and Datta, Ghosh, Steorts and Maples (2011). Using this approach, we 
suggest the benchmarked predictor based on £,f EB given by 


s :CAB 


= £ 


'AEB 


+ 


Wi 


E ra 

i-« w . 


-E 

3 =1 




'aeb\ 


A second-order unbiased estimator of the MSE of this constrained approximate Bayes 
estimator is derived. 

The paper is organized as follows: A setup of the Fay-Herriot random dispersion 
model and the approximated Bayes estimator are given in Section [2l The estimators of 
the model parameters are also given there. I 11 Section [3l the approximated empirical 
Bayes (AEB) estimator is evaluated in terms of the MSE, and the second-order unbiased 
estimator is suggested. The benchmark problem is discussed in Section HJ In Section 0 we 
investigate the performance of the proposed procedures through simulation and empirical 
studies. Concluding remarks are given in Section [ 6 ] and the technical proofs are given in 
the Appendix. 


2 Area-level Model and Estimation of Model Param¬ 
eters 

2.1 Fay-Herriot random dispersion model and an approximated 
predictor 

For m small areas, let (?/*, Vi/rii ) be the pair of mean estimate and variance estimate for 
the i-th small area, i = 1,..., m, where n* is degrees of freedom. Suppose that there exist 
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p — 1 covariates which are denoted by 27 = (zn, ..., Zi P ) with zu = 1. Then we consider 
the following heteroscedastic area-level model with random dispersions: 

Vi I CTi ~-A f(£i, CTi), 

(21) 

Vi/(Ti I Oi ~Xnv 

a~ 2 ~Ga(a/ 2 , 2 / 7 ), 


where (yi, Vi),..., (y m , V rn ) are mutually independent. We call it the Fay-Herriot Ran¬ 
dom Dispersion model (hereafter, FHRD model). Here, Ga(a/ 2, 2 / 7 ) denotes a gamma 
distribution with mean aj 7 and variance 2a /y 2 . The unknown parameters are denoted 
by w = (/3 1 , r 2 , a, y) T for (3 = (ft,..., ft) r 

Let ry = 1/a 2 and ft = l/[27r2 ni/2 r(n i /2)]. The jonint pdf of ft*, Rj, ft y*) is 


fi{y%,Vi,Ci,Vi) 


( I /ft l /io (ni+l+o:)/ 2—1 


x exp 


— ft 2 + Vi + 7 } 




( 2 . 2 ) 


It is noted that 

ViiVi - ft ) 2 + r ~ 2 (& ~ z lP) 2 + rjiiVi + 7 ) 


where 


= (Vi + t ){& - ft (Vi)} + Vi i Vi + 7 + 2 1 (y< - 2* /ft h 

T //i “T 1 


ft U ('/;) = + f 1 - 2 1 , ) (j/i - z fP)- 


Then, the Bayes estimator of ft is described as 


ft B = ftft |y*,ft] = ft/3+(i-F; 


r 2 -^ + 1 


Vi, V 


where 


E 


VhVi 


JrT( r2 Vi + 1) 1 fi(Vi, Vi, Vi)drji 


L r 2 r)i + 1 ' **’ ' *J f 0 °° fi{yi, V, rftd rji 

for the marginal pdf of /fty*, Vi, rji) given by 


fi(Vi , vj, T 7 <) =ft 


( 7 / 2) a//2 T ,n,/ 2 -l _(ni+l+a]/ 2 -l 


F(a/2) 


x exp 


T^-rij/ 2—1 (ni+l+a)/ 2 - 

li 


Vi + 7 + 


a/ r 2 ^* + 1 


{yi-zj[ 3) 2 


2 l’ ‘ ' ' r 2 7 j + 1 


(2.3) 


)(k-7/3). (2.4) 


(2.5) 


( 2 . 6 ) 
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When of = 1 /rfr is fixed and unknown, it may be estimated with Vi/rii. Then from (12.31) . 
one gets the estimator 


*iP+ i 


r * 2 {ni/Vi) + 1 


) (Vi ~ zj(3), 


which is not very stable for small n t due to the estimation error in V)/n*. The Bayes esti¬ 
mator (12.41) can fix this undesirable property. However, we resort to numerical integration 
to obtain the Bayes estimator and the empirical Bayes estimator. It may be computa¬ 
tionally harder to evaluate the mean squared error of the empirical Bayes estimator. 

We want to suggest another estimator with a closed form. To this end, we begin 
by integrating out the joint density (j2.2[) with respect to r)i. Then the marginal pdf of 
(Vi, V, Ci) is written as 


u( ^ (7/2) a/, " TA ni/2-l 

hi{yi,Vi,£i) =Ci V exp 

rl(ct/ 2) 

x T 


(6 - zj(3) 2 


2 T 2 



2 \ (ni+l+a)/2 

V 2 / V 

(l/i-6) 2 + ^ + 7 2 


Based on the density h l (y ll Id, £f), the Bayes estimator of £, ; is also expressed as = 
E[ii | Vi, Vi]. We here consider to approximate the marginal pdf hi(y i: Vi, £*). It is noted 
that 


(n^H- l-\-ot)/2 


(Vi - £i) 2 + V + 7 / 

2 \ (jii-\-l-\-cx.)/2 


V i + 1 


exp 


"• + 1 + ° log ii + hi ~ 6)2 
2 S V V, + 7 


Then, the function log{l + (r/* — ii) 2 /(Vi + 7 )} is approximated as 


log{l + (yi ~ di) 2 /(Vi + 7 )} » (j/i - ti) 2 /(Vi + 7 ). (2.7) 


This approximation can be guaranteed when n., is large. However, we use this approxima¬ 
tion for small rii as well, and derive estimators of the unknown parameters and predictors 
for based on this approximation. 

Using this approximation, we can rewrite the pdf hi(yi, as 


K(vi, U&) 

7T(a/2) 


U + 7 


(n»+l+a)/2 / m + 1 + a 


x exp 


1 


(6 - Zi /3) 


A 


(2/i - 6) s 


2 T 2 V- 2 

for A = (n, + 1 + oi)/(Vi + 7 ). It is noted that h*(y j, UA) is not a pdff. Since 


r (6-zf/3) 2 + A(?h-&) 2 = 


1 + r 2 A 




6 


zf/3 + r 2 A? /^ 2 

1 + T 2 Ai 


+ 


A 


1 + t 2 A 


( Vi-zfp ) 2 , 
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we get the approximated Bayes estimator of & given by 



zf(3 + (1 - Bi)(yi - zj(3), (2.8) 


where 6 = (r 2 , a, y) T and 



1 + r 2 (rii + 1 + a)/(Vi + 7 )' 


1 


It is noted that this is not the Bayes estimator, but the approximated Bayes estimator 
when the approximation H2.7j> is valid. Since the approximated Bayes estimator has a 
simple and reasonable form, however, we shall use this estimator even if this approxima¬ 
tion is not appropriate. The following proposition implies that the approximated Bayes 
estimator £f B has less shrinkage than the Bayes estimator given in ( 12. 4 j) . The proof 
is given in the Appendix. 

Proposition 2.1 The shrinkage function Bi in is less than the shrinkage function 
(12.5p in the Bayes estimator f R , namely, 



1 


1 + T 2 (ni + 1 + a)/{Vi + 7 ) ‘ 


2.2 Estimation of the model parameters 

We now provide estimators of the model parameters (3, r 2 , a and 7 . 

[1] Estimation of (3. Integrating out h*{y i: V$,£j) with respect to we have 




x \[2T\\J~Bi exp 


Let i* = t{(3, r 2 , a, 7 ) = Y/7=\ 4* for 4* = lo g h*{y u Vf). Since 



we get the estimator 



(2.9) 


which is the generalized least squares (GLS) estimator of (3. 
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[2] Estimation of r 2 . To estimate r 2 , we consider the expectation E[(yi —zf (3 ) 2 /(1/) + 
7 )]. The conditional expectation of {%/i — zj(3) 2 given V t is decomposed as 

E[(yi ~ zf{3) 2 | Vi\ = E[( yi - 6) 2 | Vi\ + 2 E[( yi - &)(& - z?(3) \ V ■] + £[(& - zf/3) 2 | Vi]. 

Since E[(yi-£i) 2 \ Vi,Vi,£i\ = 1/rji, E[(^-^)(^-zf/3) | = 0 and £[(&-zf/3 ) 2 | 

Vi,r)i] = r 2 , it is seen that 

E[(y l -zJf3) 2 \V i \ = E[r ] ^\V i \+r 2 . 


The joint pdf of (Vi,r)i) is 


f.(y. — _ T Vi _ K+a )/ 2 - 1 ( r?i /2)(V i + 7) 

M ” h> T(n i /2)T(a/2)2K+«)/2^ 

so that the marginal pdf of V t is 

T((ni + a)/ 2 ) 


( 2 . 10 ) 


/i(V5) = 


T(ni/2)T(a/2) (V + 7 )K +«)/ 2 ’ 
and the conditional pdf of ry given T) is 

+ a 2 


( 2 , 11 ) 


Thus, one gets 

which implies that 


Vi \Vi~ Ga 


e hr 1 1K] = 


£[(k - zf/3) 2 l v<] = 


2 ’ Vi + T 

V) + 7 
rn + a — 2 ’ 


( 2 . 12 ) 


Vl + 7 


+ rh 


rij + a — 2 

Thus, from this equality, we consider the moment E[(yi — zj/3) 2 /(Vi + 7 )], which is 


(2.13) 


(Vi ~ zlP) 2 

V + 7 


+ E 


7Zi + CK - 2 IVi + 7 J 


r 


To calculate the moments of V) from the marginal pdf ( 12 .lip , the following equality is 
useful: In general, for real numbers £ and k, it can be shown that 


E\ 


V? 


T({m + a)/ 2 ) T{m/2 + £) T(a/2 + k — £) e _ k 

-7 . 


(Vi + v) k T((7ii + a)/2 + k) T(m/2) T(a/2) 

For £ = 0 and k — 1, we have E[l/(ld + 7 )] = ot/{l('ni + «)}, so that 

-(Vr-zJP ) 2 1 1 


(2.14) 


E 


V + v 


a h 2 

-o 4-^ • 

rii + CK — 2 7lj + cx 
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When a and 7 are known and /3 is estimated by the ordinary least squares (OLS) estimator 
Pols = (Sj=i z j z J )~ 1 Sj =1 z jVji this gi yes us the estimator 


f 2 = 


m / 

a h A 

1 m 

\ (.Vi — Z IPols) 2 1 1 

rii + a) 

i —1 

1 

2=1 

l V) + 7 Uj + a — 2 J 


(2.15) 


[3] Estimation of a. Concerning the estimation of a, we concentrate on the marginal 
pdf ( 12 . lip of V). Since log/)(!/)) is expressed as 

, /t t" . , ^.ni + CK. , Oi fli — 2 , Hi + a , 

log fi(Vi) = log r( —-—)-iogr(y)-iogr(-)+-iog 7 + 2 VgV —-—iog(vs+7), 


we have 


H n ■ cv cv 

2—log m) = ^ 2)+ lo §^ - mv)+7), 


where ?/>(•) is the digamma function given by ijj(x ) = r'(x)/r(x). Since E[df t (Vi)/da\ = 0, 
one gets 

r).i 4- cv rv 

(2.16) 


77 -U O' CV 

E[log(Ej + 7 )] = ip( - - - ) - - 0 (-) + log 7 . 


We here note the following equality. For real numbers £ and k, it can be shown that 

V‘ 


E 


l(V + 7 ) k 


log (14 + 7) 


r((nj + a)/2) r(rq/2 + £) T(a/2 + k — £) e _ k 

7 


r((n, + a)/2 + k) r(rq/2) 
x 


F(a/2) 


Tii Oi x / Oi I 

—-— + k) - xp(- + k-e) + \ogi\. 


(2.17) 


For £ = 1 and k — 1, we have 


E 


V+ 7 


log (Vi + 7 ) 


rii 


rii + a 


n i + a | 1 \ / / a \ , 1 

—+ lo S7 


Since the digamma function has the property that 1/1 (x + 1) = i/?(x) + 1/x, it follows from 
(I2.16P that 


Vi 


-Vi + 7 
This can be rewritten as 
K; 


log (Vi + 7 )! = n ‘ [log (Vi + 7 )] + 

J n,- + a t 


ru + ct 


(2.18) 


a z E 


V) + 7 


log (14 + 7 ) 


+ aE 


-- log (Vi + 7 ) 


Vi + 7 


rifE 


7 


LVi + j 


log (Vi + 7 ) 


2 rii = 0 , 






































which yields an estimator of a. In fact, we can suggest the estimator as the solution of 
the quadratic equation 


14. 


a 


E17X7 lo s(^ + 7) + a y log (^ + 40 


er ^+7 




E 

i =1 


’ll* 


rij 7 

V i + 'y 


log(K + 7 ) + 2 =0. (2.19) 


[4] Estimation of 7 . Concerning the estimation of 7 , from (I2.14p . it follows that 


Vi 


V + r 


rii 


rii + a 


Thus, one gets the estimator of 7 as the solution of the equation 


Vi 


rii 


y^^=y 

“ Vi + 7 ^ rii + a 

1=1 1=1 


( 2 . 20 ) 


3 Evaluation of Uncertainty of Prediction 


Substituting the estimators of (3, r 2 , a and 7 into (I2.8[) . we get the predictor 


it EB = U*(A T 2 , S, 7 ) = z(P + (1 - fl,)(l/i - z((3), 


~AB 


where 


Bi 

3 


, «, 7) 1 + f 2 (nj + 1 + a)/(Vi + 7 ) ‘ 

m ^ m 

= ( — Bj)zjZj ^ EE — Bj)zjHji 

3 = 1 j =1 


(3.1) 


(3.2) 

(3.3) 


We call it the approximated empirical Bayes estimator. It is noted that the term (V) + 
7 )/(rii + 1 T a) in Bi is expressed as 

14 + 7 _ rij + 1 Vi C _ rii +1 \ 7 

n, + 1 + a rii + 1 + a rii + 1 ' n; + 1 + a / a ’ 

which shrinks Vi/(rii + 1) towards the target 7 fa. Thus, the predictor £f EB is a double 
shrinkage procedure such that yi and V )/(rii + 1 ) are shrunken towards zj and 7 /a, 
respectively. In this seciton, we derive a second-order unbiased estimator of the mean 
squared error (MSE) of if EB ■ 

We begin by rewriting the predictor as 

l AEB = {(1 - Bi)y , + B,zf0} - m - B,)(y, - zj0) - B t zJ(p - / 3 )}. 
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Thus, the MSE of £f EB is decomposed as 

MSE(£f EB ) = E[(ii - e,) 2 ] = 9i + 92 ~ 2c/s, (3.4) 

where 

9i =E[{(1 - Bi)yi + BizJ(3 - &} 2 ], 

g 2 =E[{(B i - Bi)( yi - zjf3 ) - B iZ J0 - (3)}\ (3.5) 

9s =E[{(1 - Bj)yi + Bizjf3 - &}{(.§< - Bi)(yi - zj(3) - B t zJ0 - f3)}}. 

To evaluate g\, g 2 and c/ 3 , we use the following theorem under the assumption (A): 
For notational simplicity, let 6 = (r 2 ,a, r y) T and 6 = (t 2 ,S, A f) T . Also, let us = (/3 T ,0 T ) T 
and cD = ((3 ,6 ) T . 

Assumption (A) 

(Al) There exist n and n such that n < rii < n for i — 1,..., m. The dimension p is 
bounded. 

(A 2 ) The matrix m _1 YlT=i z i z J converges to a positive definite matrix. 

Theorem 3.1 Assume the condition (A) and n l + a > 4 for i = 1 ,, m. Then, E[uj — 
uj\ = 0(m _1 ) and E[(u) — Lo)(uj — to) T ] = O^rn^ 1 ). Also, the conditional moments given 
Pi, Vi satisfy that E[uj — oj \ y. u Vf\ = E[u> — u>] + o p (m~ 1 ) and E[(u> — — uj) t \ yi,Vf\ = 

E[(Q — u}){Q — uj) t } + o p (m _1 ). 

We first evaluate g\. Since (1 — Bf)yi + Bizf(3 — = (1 — Bfjiyi — zj(3) — — zf(3) 

and Bi is a function of Vi, it is seen that 

9\ =E[( 1 - B i ) 2 (y i - zf/3) 2 ] + £[(& - zj(3) 2 } - 2E[(1 - B^ - z?(*){& Z 1 P)\ 
=E[{ 1 - Bi) 2 (a 2 + r 2 ) + r 2 - 2(1 - B t )r 2 }. 

Note that E[a 2 | 1 Vf\ = E[l/rji \ Vf\ = (V)+ 7 )/(rij— 2+a). Thus, one gets c/i = E[G(0, Vf)\, 
where 

G(6,V t )= V ' + A (1 - B .) 2 + t”-BI (3.6) 

Ui — 2 + OL 

which is of order O p ( 1). We here rewrite g\ as 

9i = E[G(0, V)} - E[G{0 , Vi) - G{0, Vf)} = g u ~ gu- (say) 

An exact unbiased estimator of gu is G{6 , Vf). Concerning c/ 12 , the Taylor series expansion 
give us the approximation as 

9n =E [(« - 0) T A G (0. Vi)] + \e [(§ - Of (-AE,G(0, V j)) (S - 9)] + 0(m - 3 / 2 ). 
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Since Q — uj = O p (m 1//2 ) from Theorem 13.11 it is clear that the second term in <712 is of 
order 0 (m~ 1 ). For the first term, it follows from Theorem 13 .1 1 that 


E 


(e-e) T E G{ e tVi) 



=E[C9-e) T \v i ,v,\^ § G(e,v,) 
=El(9 - 9) T }-Lc(e, V ,) + Opfm- 1 ), 


which is of order O p (rri 1 ). This shows that gn — 0 (m x ). 

For <72, it is clear that <72 = 0(m _1 ). For <73, it is noted that 


93 =E[{( 1 - Bi)yt + Bizjl3 - Efe \ y u K]}{(£; - 
- £[{(1 - Bi)yi + Bizjfi - Efa \ y h VJ]}^ 


Bi)(yi — zj( 3 ) - BizJ (3 - ( 3 )}} 

-B^w-m- 


The second term is of order 0 (m x ). For the first term, 


EHil-B^yi+BizJ( 3 -Efa \ y u V$}{E[Bi-Bi \ y^V^yi-zJf 3 )-B i zJE\( 3-(3 \ y^Vff)}, 


which is approximated as 

E[{(l-B i )y i + B i zl(3-E[Z i \ yi ,V i \}{E[B l -B l }(y i -zJf3)-B l zjEip-(3]}} + o(m- 1 ). 

This shows that <73 = 0(m -1 ). Hence, we get the following proposition. 

Proposition 3.1 Assume the condition (A) and n* + ct > 4 for i — 1 ,..., m. Then, the 
MSE of the predictor ff EB is decomposed as 

MSE (£? eb ) = g n + {-<? 12 + 92 - 2g 3 }, 

where gn = 0(1), gn = 0(m~ l ), g 2 = 0 (m _1 ) and g 3 = 0 (m _1 ). 

We next estimate the MSE of £,f EB . An exact unbiased estimator of < 7 n is given by 

9n = 0(6, Vt) = -h±I_(i - Bi) 2 + f 2 §l 

ni — 2 + a 

To provide second-order unbiased estimators of < 712 , <72 and g 3 , we use the parametric 
bootstrap method. Let (y*, V*), i — 1,..., m, be a bootstrap sample generated from the 
model: 

~J\f(zfP,T 2 ), 

V *V* I V*i ~x 2 ni , 

Vi ~Ga(a/ 2,2/7), 

where (3 , f 2 , a and 7 are estimators constructed from the original model (12.11) . The 
bootstrap estimators (3 , r*, a* and 7 * are calculated via the same manner as in (3, f 2 , a 
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and 7 except that the bootstrap estimators are calculated based on (y *, V)*)’s instead of 
(yt, U))’s. Then we can estimate < 712 , 92 and g 3 with 


gh =E‘\G(e", v') - G(d, oi. 

92 =S-[{(B* - B*)(</* - 73) - 

93* =B*[{(1 - B-)9* + Btzfp - e*}{(B* - - 


7) 


B*z, J 


'(/3 


3 )}], 


(3.8) 


where 6 = (f*,a?*, 7 *) r , B* = Bi{Q,V*) and B* = BfG ,V*). It can be seen that these 
are second-order unbiased estimators. 


Proposition 3.2 Assume the condition (A) and 77 + ck > 4 for i = 1, ... ,m. Then, a 
second-order unbiased estimator of the MSE of £f EB is 

mse(£f ER ) = g u + {-g* 12 + g* 2 - 2 g* 3 }, (3.9) 

where E[g u ] = g u , E[g* l2 ] = g 12 + o(m _1 ), E\g* 2 ] =g 2 + 0 (m ~ x ) and E[gf\ =g 3 + 0 (m _1 ). 


4 Benchmarked Prediction 

In this section, we consider the benchmark problem which imposes a constraint on pre¬ 
dictors for small areas. The benchmarked predictors are derived and an approxomated 
unbiased estimator of their MSE is provided. 

Although the predictors in (13. ip give reliable estimates for by borrowing strength 
from the surrounding areas, we are faced with a potential difficulty of the predictor. That 
is, the overall estimate for a larger geographical area, which is constructed by a (weighted) 
sum of is not necessarily equal to the corresponding direct estimate like the overall 
sample mean. To describe it specifically, let w/'s be nonnegative constants such that 
J2jLi w j — 1- Suppose that the mean of the total areas is estimated by the weighted 
sum of yj s, Xp=i w jUj. Then, the benchmark problem is described as an issue of finding 
estimators 5j such that 

m m 

w 3 s j = Wiy j = y*- ( 4 - 1 ) 

j =1 j =1 

A solution of the benchmark problem is the constrained Bayes estimation suggested by 
Ghosh (1992) and Datta, Ghosh, Steorts and Maples (2011), who considered the min¬ 
imization of Y2iLi E [(^i — £j ) 2 | Data ] under the constraint (14. ip . Using the Lagrange 
multiplier method, one gets the constrained Bayes estimator 

m 

S ? B = E [& I Vi, A y w - w i E & I Vt v j]}- 

2^j=i w j j=1 J 
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Since the Bayes estimator E[£i | yi,Vf\ cannot be expressed in a closed form, we replace it 
with the approximated empirical Bayes estiamtor given in (13.11) . The resulting bench- 
marked predictor is 


S? AB = £ 


AEB 


+ 


Wi 


E m 

,=i w . 




j = 1 


(4.2) 


which is here called the constrained approximate Bayes estimator. 

To evaluate the uncertainty of 8 EAB , we derive a second-order unbiased estimator of 
thh MSE. The MSE of 8 f AB is decomposed as 

E[(5? AB - m =E[{i AEB - 


wt 


(E7=x: 


(y v 


m 

£ 

3 =1 


w£ aeb Y 


+ 2 


Wi 


E m. 

7 = 1 


Wi 




where 


J 


E 




'AEB 



m 


S>#“) 


The second-order unbiased estimator of the Erst term E[(^ aeb — £j) 2 ] is given in Propo¬ 
sition 13.21 Clearly, an exact unbiased estimator of E[(y w — J2jLi w j^f EB ) 2 ] is (V w ~ 

EJj=i w j€f EB ) 2 - I 11 Theorem 14.11 given below, we verify that J = 0(1). Then, we can 
estimate J based on the bootstrap sample given in (13.7p as 


J* = E* 




*AEB* 


3 = 1 


which satisfies that E[J*] = J + o(l). 


Theorem 4.1 Assume the condition (A) and rii + a > 4 for i — 1 ,... ,m. Also assume 
that EJ=i w 'j/ m converges to a non-zero constant. Then, J = 0(1) and a second-order 
unbiased estimator of the MSE of 5f AB is 


mse(S EAB ) = mse(f AEB ) + 


AEB\ 


wt 


(E7 =1 ^ 2 ) 2 L 


(y w -J2 w $ 

3 =1 


AEB\ 2 


+ 2; 


Wi 


;J*, (4.3) 


E m 9 
3=l W 3 

where mse(( AEB ) is given in (13.91) . That is, E[mse(6f AB )] = E[(8f AB — £*) 2 ] + o{m~ l ). 
The proof of Theorem 14.11 is given in the Appendix. 


5 Numerical and Empirical Studies 

In this section, we investigate performances of the procedures suggested in the previous 
sections through numerical and empirical studies. 
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5.1 Simulation study 

Here we investigate finite sample performances of the estimators in the Fay-Herriot ran¬ 
dom dispersion (FHRD) model and the second-order unbiased estimators for the un¬ 
conditional MSEs by the Monte Carlo simulation. Comparing the performances of the 
approximated Bayes estimator given in (I2.8j) with those of the Bayes estimator 
given in (12.41) . we check goodness of the approximation we applied. 

We conduct simulation experiments as we specified true model, so simulation data is 
generated by FHRD model (12.11) . Throughout the simulations, the true value of (3 and 7 
are /3 — 10 and 7 = 1 . For each of m, r 2 , a, we examined two cases; m = 30 or 60, r 2 = 1 
or 4 and a = 1 or 4. For simplicity, we set z t — l, p —1 and n t = 10 for all areas and 
cases. Thus, there are eight cases of similations for the variety of m, a and t 2 . 

We forst compute numerical values of MSE of the Bayes and approximate Bayes esti¬ 
mators and with 

M S E , = if (|f>- 5 f ) 2 

fc=l 

for K = 5, 000 where and are the estimator and the true value of £,,■ in the k-th 
replication for k = 1 ,,K. To investigate the loss which arises from approximation 
we compare the approximated Bayes estimator with the Bayes estimator 
in terms of biases and true MSEs under known model parameters. The results of the 
simulation are reported in Table [0 


Table 1: Biases and square roots of MSE of and in the FHRD model under known 
model parameters 


Estimator 

a, 

r 2 

Bias (m=30) 

SRMSE (m=30) 

Bias (m=60) 

SRMSE (m=60) 


1 , 

1 

0.002 

0.818 

- 0.002 

0.822 

k B 

Sz 

1 , 

4 

0.003 

1.347 

-0.005 

1.346 


4, 

1 

-0.005 

0.528 

0.000 

0.528 


4, 

4 

-0.005 

0.629 

- 0.002 

0.628 


1 , 

1 

0.002 

0.824 

- 0.002 

0.828 

CAB 

Sz 

1 , 

4 

0.003 

1.355 

-0.005 

1.355 


4, 

1 

-0.006 

0.530 

0.001 

0.530 


4, 

4 

-0.005 

0.631 

- 0.002 

0.629 


It is observed from Table Q] that the difference between £ B and is tiny. Even 
though £f B is dominated by as expected, the difference of the biases is little except 
the case (cqr 2 ) = (4,1). Moreover, the largest difference between the two SRMSEs is 
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0.009 for m = 60 and (cqr 2 ) = (1,4). Thus, the approximation little affects the bias and 
MSE. 

We next investigate finite sample performances of the estimators for the model pa¬ 
rameters. In particular, it is worth remarking the estimation of a. Initially, we used the 
maximum likelihood estimator of a from the marginal likelihood as Maiti et al. (2014). 
The MLE can be obtained by solving the equation based on the digamma functions. How¬ 
ever, the numerical solutions for the MLE yield large variability. To avoid such an instable 
performance of the MLE, in this paper, we suggest the new consistent estimator given in 
(12.191) . The performances of the suggested estimators for /3, r 2 , a and 7 are reported in 
Table [21 where means and standard diviations via simulation with 1,000 replications are 
given. Table [2] shows that the estimator of (3 is almost unbiased and has small standard 
deviation. For other estimators, both biases and standard deviations are moderated as m 
increases. Espetially, the suggested estimator (12. 19[) of a provides stable estimates and a 
good performance. 


Table 2: Results of the estimation for model parameters (3, r 2 , a and 7 in the FHRD 
model for (3 = 10 and 7 = 1 (Standard deviations are shown in the parentheses) 


m a, 

r 2 

b 

T 2 

a 

7 

1 , 

1 

10.001(0.331) 

0.912(0.658) 

1.041(0.160) 

1.092(0.262) 

m = 30 1, 

4 

9.997(0.495) 

3.658(1.834) 

1.038(0.157) 

1.092(0.269) 

4, 

1 

10.000(0.217) 

0.950(0.361) 

4.067(0.538) 

1.013(0.085) 

4, 

4 

10.006(0.384) 

3.876(1.235) 

4.063(0.543) 

1.015(0.085) 

1 , 

1 

9.999(0.226) 

0.944(0.483) 

1.135(0.189) 

1.203(0.346) 

m = 60 1 , 

4 

10.006(0.345) 

3.883(1.321) 

1.018(0.114) 

1.036(0.167) 

4, 

1 

10.000(0.148) 

0.977(0.254) 

4.029(0.377) 

1.006(0.061) 

4, 

4 

9.998(0.268) 

3.928(0.880) 

4.036(0.383) 

1.005(0.062) 


Finally, we compare the second-order unbiased estimator of the MSE of with 

the true MSE. Concerning the MSE, the true value is calculated via simulation with 
R = 5, 000 replications as 13.41 Then, the mean values of the estimator for the MSE and 
their Percentage Relative Bias (RB) are calculated based on T = 1,000 simulation runs 
with each 1,000 bootstrap samples, where RB is defined by 


(0 


RB, = 100 


T Ef=i MSE) - MSE 
MSE, 


-(*) 

for the MSE estimate MSE in the t-th replication for t — 1,..., T. Note that both true 
MSE and its estimator are calculated based on our estimates of the model parameters. 
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Table [3] reports values of the true MSE, the second-order unbiased estimator MSE and 
the corresponding Percentage Relative Biases. It is observed that the MSE estimates 
MSE are close to the true values of the MSE, and their relative bias are small for both 
m = 30 and 60. Thus, the second-order unbiased estimator of the MSE performs well as 
an estimator of the MSE of £f EB in the FHRD model. 


Tabic 3: Relative biases of the MSE estimator for £f EB in the FHRD model 


Size a, 

r 2 

MSE 

MSE 

RB(%) 

1 , 

1 

0.996 

0.952 

-4.379 

m = 30 1, 

4 

2.22 

2.243 

1.042 

4, 

1 

0.312 

0.323 

3.580 

4, 

4 

0.416 

0.414 

-0.443 

1 , 

1 

0.835 

0.833 

-0.233 

m = 60 1, 

4 

2.026 

2.011 

-0.719 

4, 

1 

0.294 

0.298 

1.284 

4, 

4 

0.399 

0.405 

1.424 


5.2 Illustrative examples 

We apply the approximated empirical Bayes estimator and the estimator of the MSE to 
the data in the Survey of Family Income and Expenditure (SFIE) in Japan. 

In this study, we use the data of the spending items ‘Education’ and ‘Health’ in the 
survey in 2014. For the spending item ‘Education’, the annual average spending (scaled by 
1,000 Yen) at each capital city of 47 prefectures in Japan is denoted by yt for % = 1,..., 47, 
and each variance V) is calculated based on data of the spending ‘Education’ at the same 
city in the past consecutive eight years. Although the annual average spendings in SFIE 
are reported every year, the sample sizes are around 50 for most prefectures. We apply 
the same manner to the spending item ‘Hclth’ to create yt and Vi . The data of the item 
‘Education’ have high variability, but those of the item ‘Health’ have relatively lower one. 

In addition to the SFIE data, we can use data in the National Survey of Family Income 
and Expenditure (NSFIE) for 47 prefectures. Since NSFIE is based on much larger sample 
than SFIE, the annual average spendings in NSEDI are more reliable, but this survey has 
been implemented every Eve years. In this study, we use the data of the spending items 
‘Education’ and ‘Health’ of NSFIE in 2009 as covariates z % for i — 1,... ,47. Thus, we 
apply the FHRD model (12. ip to these examples, where zj(3 = /3 0 + Zij3\. 

We calculated the predicted values of £,f EB and and the estimates of the MSE of 
£ f EB with the estimates V). These values in seven prefectures around Tokyo are reported 
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in Tables [4] and [5] for the ‘Education’ and ‘Health’ data. For the ‘Education’ data, the 
estimates of the model parameters are /3q = 15.711, /3i = 0.140, f 2 = 12.069, a = 2.050 
and 7 = 2.764. For the ‘Health’ data, the estimates of the model parameters are (3q = 
8.819, /?i = 0.192, f 2 = 5.497, a = 9.502 and 7 = 2.109. As seen from the tables, 
the ‘Education’ data have more variability than the ‘Health’ data. The approximated 
empirical Bayes estimator £f EB returns almost similar values as the empirical Bayes 
estimator ^ EB does. Both estimators do not shrink y* so much. It is also from Table [4] 
that £,f EB and £f B shrink yi more toward /3q + Zi/3 1 when the values of V are larger. The 
MSE estimates of £,f EB give large values for large Vi’s. 

Table 4: Predicted values and the MSE estimates for the ‘Education’ data 


Prefecture 


Vi 

zjj3 

?AEB 

CEB 

Si 

MSEaeb 

Ibaraki 

4.210 

21.972 

17.873 

21.768 

21.851 

1.098 

Tochigi 

4.974 

21.883 

18.102 

21.675 

21.768 

1.157 

Gunma 

11.157 

14.115 

17.933 

14.475 

14.287 

1.772 

Saitama 

72.622 

32.608 

19.309 

27.805 

29.064 

5.868 

Chiba 

26.419 

21.554 

18.751 

21.050 

21.274 

3.144 

Tokyo 

13.091 

22.037 

19.337 

21.750 

21.915 

2.084 

Kanagawa 

16.266 

22.321 

18.494 

21.843 

22.106 

2.260 


Table 5: Predicted values and the MSE estimates for the ‘Health’ data 


Prefecture 

Vi 

Vi 

zJ/3 

?AEB 

S i 

CEB 

M 

MSEaeb 

Ibaraki 

1.160 

10.351 

10.946 

10.369 

10.410 

0.211 

Tochigi 

3.964 

11.759 

11.080 

11.720 

11.572 

0.369 

Gunma 

3.444 

8.737 

10.307 

8.818 

9.139 

0.349 

Saitama 

0.920 

11.133 

11.316 

11.138 

11.146 

0.194 

Chiba 

3.720 

12.808 

11.150 

12.718 

12.388 

0.358 

Tokyo 

1.161 

13.803 

10.959 

13.714 

13.477 

0.208 

Kanagawa 

0.479 

14.496 

11.088 

14.411 

14.293 

0.163 


6 Concluding Remarks 

In the Fay-Herriot random dispersion (FHRD) model, we have derived the approximated 
empirical Bayes (AEB) estimator with the closed form and provided the second-order 


17 








unbiased estimator of the MSE of the AEB estimator via the single parametric bootstrap 
method. Through various simulation experiments and empirical studies, it has been shown 
that the difference between the AEB estimator and the empirical Bayes estimator given 
in Maiti, et al. (2014) is small. This means that the AEB estimator is useful irrespective 
of validity of the approximation. It has been observed that the estimators suggested in 
this paper for the model parameters have good performances. Especiall, our estimator of 
a is described in the closed form, and it performs well. 
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A Appendix 

We here give proofs of Proposition 12.11 and Theorems 13.11 and 14.11 

[1] Proof of Proposition 12.11 It follows from (12.5ft and (j2,6[) that 

fcTi^Vi + 1 ) _1 A(?7iK*(^)% 


Lr\ + 1 


Vi,Vi 


f 0 °° D i(vi)g*(vi)^Vi 


where 


9*(Vi) =rjl ni+1+a)/2 1 exp[-77 i (y i + 7)/2], 


Di(rji ) 


\J r 2 7ii + 1 


exp 


Vi 


{Vi ~ zff3) 2 


2 ( 7 - 27 /; + 1) 


It is noted that ZJ;(r/;) is a decreasing function of 7/;. Then, we first show that 

/o°°( r2 ^ + i) _1 A(^k*(^) d ^ . /o°°(Ai + ly'gtivd&Vi 


> 


/o°° 9*(Vi)dVi 


f 0 °° A (vi)g*(vt)dvi 

This inequaity is equivalent to 

A[(r 2 r/; + 1 )~ 1 D i {r] i )] > £*[(r 2 Vi + 1) _1 ]A[A(^i)], 


(A.l) 


(A.2) 


where E*[-] is the expectation with respect to the pdf C t g*(rji) for some constant G;. The 
inequality flA.2[) is equivalent to 


Cov*((t rji + 1 ) ,Di(r}i)) 


= E * 


{(r 2 Vi + I)’ 1 - A[(r 2 r/; + - E,[D t ( Vi )}} 


> 0 , 


which holds since both (r 2 rji + 1) 1 and Di(rji) are decreasing in 7 /;. Thus, one gets the 
ineqaulity (lA.lj) . 
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Since (r 2 r]i + 1) 1 is a convex function of rji, the Jensen inequality is applied to show 
the inequality 


/o°°( r2 ^ + 1 ) 'gtivMVi . ( 2 fc?°Viffi(Wi)dVi 


S™ 9*(Vi)dVi 


> T 


fo°° 9* (vP^Vi 


+ 1 


-l 


Noting that g*(r)i) is proportional to the pdf of Ga((rii + 1 + o)/2, 2/(V* + 7 )), we can see 


that f °° Tjig*(rji)drji/ f 0 °° g*(r/i)dr/i = (m + o + 1)/(V + 7 ). Namely, 


iT &*(+;)% 




r 2 (uj + a + l)/(V r i + 7 ) + 1 ' 


(A.3) 


Combining (IA. 1 D and (IA.3[) proves Proposition 12.11 


[2] Proof of Theorem 13.11 For notational simplicity, let 6 = ( 6 *i, 6 * 2 , 6 * 3 )^ = 
(t 2 ,o, 7 ) t and 6 = (0i,0 2) ^3) T = (t 2 ,o, 7 ) 71 . Since (3 is expressed as (3 = (3(d), the 
Taylor series expansion gives that 


_^ PI r\ t r) 

P-(3=p-(3 + J2{ - B j) z i z j) ( ~de Lz ^)^ 

a=l j=1 j=1 a 


(A.4) 


/ \ -1 m OD . . 

- (V ^ 1 - B j) z j z J) ~^r ZjZ ^\^ a ~ 6a) + 


j=i 


i=i 


where /3* = {Y,"U(dB j /d9 a )z j zJ} 1 Y^=i( dB j /dO a )z j y j - Since E[(yi - zj (3) 2 \ Vi] = 
(V + 7 )/(rii + o — 2) + r 2 from (I2.13jl . it is observed that 


E[(0 - 0)(0 - 0) T I VS] =e[(E(1- zjzf(l - B 


1=1 

x 1 

1=1 


1=1 

I V 


nj + o — 2 


+ T 


which implies that A[(/3 — /3)(/3 — /3) 7 ] = 0(m 1 ), and (3 — (3 = O v (m x ^ 2 ) under the 
condition (A) for rij + o > 2 . Also, it is seen that 


E\(0 -0W- BY I Vi, K] = £[(/3 - /3)(/3 - /3) T ] 

-1 


(A.5) 


+ _ b j) z j z J) z i z ^i i - B if[(yi - zip ) 2 - 
1=1 

-1 - 

I Vi, V 


Tlj + o — 2 


+ + 


x 1 _ 5 l) z l 2 

l=i 
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which shows that E[(/3 — (3) ((3 — (3) T \ yi,Vi] = E[((3 — (3)((3 — /3) T ] + O p {m 2 ) and 
(3 — (3 | yi, Vi — O p (m -1 / 2 ). Clearly, E[( 3 — (3\ — 0, and it is observed that 


E[0-0\ Vi, VS] =B { £(1 - BJzjzj } £(1 - B,)z,( yj - zj 0) | Vi , VS 

3 = 1 l=i 


-1 , 


{D 1 - B >>*: 
1=1 


-1 


y*, c, 


(1 - Bi)zi{yi - zf(3), 


which means that E[(3 — (3 \ If] — O p (m 1 ). Similarly, we can show that E[j3* — (3 \ 

Hi, If] = O p (m~ l ) and (3* — (3 \ y 7 If = O p (m -1 / 2 ). Thus, from (1A.4I) . we can verify that 
E[0 - /3)(3 - /3) T H 0(m _1 ), E[3 - /3 | ^ V^= +o p (m- ] 0 and £[(3 - /3)0 - (3) T \ 
yi , Vi] = Tf(/3 — /3)(/3 — /3 ) T ] + o p (m _1 ), provided 0 = (ffi, 0 2 , 9 3 ) T satisfy the results given 
in Theorem 13.11 

We now prove the results concerning 0 in Theorem 13.11 Let F{0) = (if (0), if(0), if (0)) r , 
where 


W) 

* 2 ( 0 ) 

*3(0) 


1 y" f a h r 2 

m ^ l rin + a 
1= 1 

m T t 

if 

m ^ l If + 7 
l=i J 


+ 


(yj — Z J Pols)' 


rii + a — 2 


VS'+7 


log (If- + 7 ) + aiij 


Vj~ 7 

If+ 7 


log(lf- + 7 ) 



n i \ 
rij + a J 


n 2 7 


VS + 7 


log(lf- + 7 ) - 2 raj 




Since F(0) = 0, the consistency of 0 follows from the Cramer method explained in Jiang 
(2010). It is noted that for a = 1,2, 3, 


F a (d) = F a (0) + 
which yields 


9if(0) 

DG t 


1 02 P 

(0 - 0) + -(0 - 0) t ^-^(G - G) + o p (\\G - G || 2 ), 

2 0000 


0 — 0 = — 


9F(0) 
90 r 


-1 


*X0) - 7 


1 /9F(0) 


2 V dG 1 


Col. (0-fl) T ^(0-0) 


9090 


+ °p(l|0 — 0 ||^)j 


(A. 6 ) 


where Col a (x a ) = (xi,x 2 ,x 3 ) t and ||0 — 01 | 2 = (0 — G) T (G — 0). Hence, it is sufficient to 
show that E[{F a (G)} 2 ) = 0(m _1 ), L;[{F a (0 )} 2 | y t , If] = O^m" 1 ), £[if(0)] = O p (m _1 ) 
and i?[if(0) | 2 /*, Vf] = O p (m _1 ) for each a, and dF(G)/dG T converges to a positive 
definite matrix. 
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Concerning Fi(0), note that 


nw 


W.») + -E 

3 =1 


Vj~ z ]P 

Vj + If 


Z J (Pols 


ft) + O p (m 4 ), 


where 





a /7 2 

-r 

rij + a 


+ 


1 

rij + a — 2 


(//, -^) 2 1 
C J + 7 I' 


It can be verified that E[{Fi(6)} 2 ] = 0(m _1 ), F[{Fi(0 )} 2 \ y t , VP\ = O p (m -1 ), F[Fi(0)] = 
O p (m _1 ) and F[Fi(0) | y i: Vp = O p (m _1 ) if there exists E[{(yj — zJ/3) 4 /(Vj + 7 ) 2 ]. Sim¬ 
ilarly, the corresponding properties of the moments for F 2 (0) and F :i (6) can be demon¬ 
strated if there exists F[{log(V} + y)} 2 ]. Thus, we need to check these moments. It is 
noted that 


mvi - zfpr i Vj\ =E[(y f - o) 4 +6 ( Vj - + & - o 4 1 ya 


=E 


+ 


6 r 2 


+ 3r 4 I 14- 


l Tj Vj 

m+i) 2 


+ + 3 t 4, 


(rij + a — 2) (nj + a — 4) nj + a — 2 


so that F[{(t/j — zJf3) 4 /(Vj + y) 2 ] is finite if rij + a > 4. To investigate the existence of 
F[{log(V}+ 7 )} 2 ], we calculate both sides of 4F[— (d 2 /da 2 ) log /(Vj)] = 4F[{(<9/<9a) log f(Vj)} 2 ]. 
The RHS is equal to E[{ip((rij + a)/2) — ^(a/ 2 )+log 7 — log(Vj + 7 )} 2 ] = {'ip((rij+a)/2) — 
ip (a/2) + log 7} 2 — F[{log(Vj + 7 )} 2 ]. On the other hand, the LHS is —ip 1 ((rij + a)/2) + 
ip'(a/ 2). Hence, 


£[{log(Rj + T)} 2 ] = {P((nj + a)/ 2 ) - ^(a/ 2 ) + Og 7} 2 + ip'((rij + a)/ 2 ) - ip' (a/ 2 ), 


which is finite for a > 0 . 

Finally, we show that every entry of the matrix dF(0)/d6 r converges in probabiltiy. 
For notational simplicity, let F a ^(0) = dF a (6) / d6i for a = 1,2,3 and i = 1,2,3. Then, 
for Fip), we have Fqq = m -1 JF a/{ 7(77 + a)}, and 


J_ f n j r2 h _1_1 ^ = J_ f r V7 2 . fa ^J/^oLg) 2 ) 

m “ l (rij + a ) 2 (rij + a — 2) 2 / ’ 1(3) m “ l rij + a (Vj + 7) 2 / 


For F‘ 2 (jj , we have F 2 (p = 0, and 


F 2 ( 2 ) 

F 2 (3) 


1 ^ log(Vj + 7 ) 


m 


K- + 7 


{2aVj + rij(Vj — 7 )}, 


- 1 E 5 vrw(“+"j) I + i E 

ffl Z —' (V- —I— o/l 2 v J m Z. —/ 


a + n 


'3 


(Vj + 7 ) 2 


m ' (Vj + 7) 2 


{aVj - riji). 
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For F 3 (j), we have F 3 (i) = 0, and 


-^3(2) — 


E 


71 i 


m (rij + a) 2 




v .;■ 


m ; (^i + 7) 2 ' 


Thus, it can be seen that these converge to the limiting values of their expectations if 
there exist the moments E[{(y 3 — zj f3) A /(V 3 + y) 2 ] and E[{\og(V 3 + 7 )} 2 ]. are finite. 
Therefore, the proof of Theorem 13.11 is complete. 

[3] Proof of Theorem 14.11 ft is noted from (12.4p that = E[^ \ yi,Vj\ = 
zj (3 + (1 — Ei)(yi — zj (3) for E t = E[(r 2 r]i + 1 ) _1 | y j, V,}. Then, J can be rewritten as 


J=E 


=E 


(r fl -e. B )(F„-E ™& EB ) 

3 = 1 
m 

(■Bi ~ Ej) (r/j - zf(3)^ j w j B j (y j - zj(3) 

3 = 1 

m 

Bizf (3 - /3) - (Bi - Bi)( yi - zj(3)\ ~ z jP) 


3 = 1 
m 

(Bi - Ei)(vi - zJ(3)J2 w i{(Bj - Bj)(yj - zj 3) - #jzj(3 - /3) 
j=i 

—Ji + + </ 3 - (say) 

Noting that Ei is a function of V) and (y t — zj/3) 2 , we can see that 

(Bi - E i )(y i - zj(3) 2 for i = j, 


E[(B, - E,)(y, - zjf3)( yi - zj0) \ V„ V,] = 
Thus, Ji is evaluated as 
Ji =E 


0 


for i 7 ^ j. 


Wi 


Bi(Bi - Ei)( yi - zj(3) 2 + (Bi - E i )'Yj l w j B j (yi - zjf3)(y 3 - zj(3) 

j¥=i 

=E[w i B i (B i - Ei)(yt - zj /3) 2 ], 

which is of order 0(1). Noting that (3 — (3 = Op(m^ 1/,2 ) and B { — B^ = O p (m~ 1//2 ), we 
can demonstrate that 


J 2 =E 


E=E 


Bizj (3 ~ (3)- (Bi - Bi)( yi - zjf3)\j2 w jB j (y j - zjf3) + o(l) 


j= 1 


(Bi - B,)ta - 4/3) E ro /{(b - Bj)fe - 4/3) - B i z J (3 - /3)}J + 0(1). 

i=i 
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It is easily seen that 


m r 

E [{J2 w 3 D 3(yj - Z J( 3 ')} 




3 = 1 


i=i 


which implies that Y^j=\ w jBj{yj ~ Z Jfl) — O p {m 1//2 ). Thus, one gets that J 2 = 0 ( 1 ). 
Concernig J 3 , it is noted that f 2 given in (12. 15(1 is approximated as 


f 2 = 


E uy i \ 

n ■ -I - n/ ) < 


2—1 


rii + a 


2—1 


a/7 v 1 ^ r(yi-*W 


+ O p (m 1/2 ), 


Vi + 7 n* + a - 2 
so that we can regard Hi as a function of (y* — zj(3) 2 and Vi, i = 1,..., m. Hence, 

m 

E (Bi - Ei)(yi -zjf3)^2 w j( B j - B j)(Vj - Z J P) = E [( B i ~ E i)(Vi ~ zj f3) 2 w i {B i - Bi)\, 

3 =1 

which is of 0{m~ 1 ^ 2 ). Since f3 — (3 = O p {m~ lB ), it is seen that 


E 


{Bi - Ei){yi - zj (3) ^ WjBjzJ {(3 - (3) \V 1 ,...,V m 


3 = 1 


=E 


x 


=E 


{Bi - Ei){yi - zJf3)J2 w 3 B jzJ (^(1 - B a)z a zl 


-i 


3 = 1 


a= 1 


5^(1 - B a)z a {y a - zl(3) I Hi,..., 14 


a=l 


- Hi)(yi - zf/3 ) 2 ^ uyH^J ( ^(1 - H a )z a ^j (1 - B % )z % \V 1 ,...,V m 

3 = 1 


-1 


a=l 


which is of order O p (l). Hence, it is concluded that J 3 = 0(1). Therefore, the proof of 
Theorem 14.11 is complete. 
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